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Abstract 
Every  linear  congruential  random  number  generator  that  uses  a  power  of 
two  as  modulus  introduces  correlations  among  elements  separated  sequentially 
by  powers  of  two.   In  particular,  we  have  the  following  Theorem: 


Let  V  .  _  ax   +  b   mod  2^ 


a  ■  1  mod  2 

where 


a  y<  1  mod  2'*'^'^   and  fi  >    a>  1. 


Then  for  every  k  the  linear  relation 


P  B 

S  c.x    1,  ■  *^  "'°^  ^ 
j-0   J  n+j2 


holds , 


where  J 


(;9+Q)/(k+Q)   if  b  is  odd 
p  is  thf;  smallest  integer  >_ 

/9/(k+a)      if  b  -  0 
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The  construction  of  random  number  generators  Is  an  old  art  and  a 
recent  science.  There  are  two  extreme  questions  that  naturally  arise,  and  a 
plethora  of  Intermediate  ones.  One  extreme  is  whether  one  really  needs  a 
sequence  to  simulate  randomness  for  a  given  computational  task;  here,  little 
has  been  done   since   the  fascinating      start  by  Richtmyer  years    ago.       The 

other  extreme  is  that  of  devil's  advocate:  does  the  structure  that  creeos 
into  any  random  number  algorithm  act  to  render  SBspect  or  even  wrong,  its 
application  to  a  given  task?  A  fairly  recent  paper  of  Filk,  Marcu  and 
Fredenhagen  ^  '  has  addressed  this  question  in  the  context  of  lattice  gas 
simulations  in  which  stepping  by  powers  of  two  is  an  intrinsic  structural 
component  of  a  typical  program.  They  showed  that  a  primitive  linear 
congruential  random  number  generator  introduces  correlations  among  elements 
separated  sequentially  by  powers  of  two,  which  thereby  introduce  errors 
into  Monte  Carlo  procedures  unless  palliative  measures  are  taken.  We  would 
like  to  indicate  in  this  note  that  the  phenomenon  is  not  restricted  to  this 
special  generator,  but  is  a  simultaneous  property  of  all  linear  congruential 
generators  with   fixed  multiplier  using  a  power   of   two   as  modulus. 

The   general   linear   congruential   generator   takes   the   form 

X     -  a  X     ,    +  b      (mod  m)    ,  (1) 

n  n-  i 

generating    a    sequence    of    integers   between    0    and   m,    or   dividing  by  m,    of 

fractions  between  0   and  ^^-    ;    the   choice   m  -   2^   is   essentially  mandatory   for 

m 

efficient    programming    of   binary-based  digital   computers.   The   iteration   of 
(1)    is   readily   carried  out,    yielding  the   formally  explicit 

X     -  aV   +  ^  b      (mod   2^)    .  (2) 

n  0  a-1 

It  is  easy  to  see  that  if  a  -  1  (mod  4)  and  b  is  odd,  then  (Xq,Xj^  ,  .  .  .  ,  x^_  ^  ) 

is  a  permutation  of  {0,1,2, m-1)  .   For  a  fixed  k,  we  now  ask  whether 

there  exists  a  guaranteed  linear  relation  among  entries  in  the  chain 
separated  by  2  ; 


S  c.x      -  0  (mod  2^)  .  (3) 

0  J  n+j2'^ 

Substituting  (2)  into  (3),  this  will  be  the  case  for  given  x^  and  b  if 

f(a)xQ  -  0  (mod  2^)  . 

^^^^^  b  -  0   (mod  2^  .  (4) 

b      k 
where  f(0)  -  E  c.a-^ 
0  J 

The     case     b     -     0,     Xq     odd,     was     studied    by    Filk,     Marcu     ,     and 

Fredenhagen  ,    here    one    only    requires 

f(a)    «   0      (mod   1^-)    ,  (5) 

independently    of    x„ .      The   basic  relation    of  type    (5)    is    the  Euler    totient    formula' 
which  becomes    in    the    present   case 

a  -1=0      (mod   2^)     .  (6) 

However,  there  are  numerous  polynomials  of  lower  degree  that  satisfy  (5). 
For  relations  between  {x  )  separated  by  2  ,  these  are  most  readily  generated 
from   the   primitive    case 

&-      -    1    -   0      (mod   2"^^^^)  (7) 

[31 
for    suitable    7(k)  .       The    totient    formula  guarantees    that   7(k)    >   k+1,    but 

the   decomposition 

«k  k-1        „j 

a        -    1   -    (a-1)      n      (a        +   1)  (8) 

j-0 

establishes  at  once  the  result  that  if  a  ■  1  (mod  2  )  ,  then  7(k)  >  k+a.   If 
in  addition  a  /  1  (mod  2    )  then  (8)  guarantees  that  7(k)  -  k+a.   In  any 
event,  we  see  at  once  from  (7)  that,  for  example, 

(a2\i)(^A(k))  .0   (mod  2^  ,  (9) 

where  (c/d)  -  1  +  [(c-l)/d]  is  the  smallest  integer  >  c/d.   Thus  (3)  holds, 
with 

(10) 


:.  .  (.i)J  [(^/-r(k))  j  . 
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The  specialization  b  -  0  in  (1)  is  unnecessasry  and  is  in  fact 
completely  inappropriate  for  vector  random  number  generators  which  are 
natural  eemponents  of  highly  parallel  programs.  Proceeding  then  to  the  more 
standard  generators  in  which  b  is  merely  odd,  ye   require  in  addition  to  (5) 

now  independently  of  x^  and  b.   Indeed,  (11)  implies  (5)  if  we  impose  the 
condition 

f(l)  -  0  ,  (12) 

which  we  shall  do.   Suppose  now  that 

a  ■  1   (mod  2  ) 


but  a  ?<  1   (mod  2"^"^^) 


(13) 


Then  (11)'  with  (12),  is  equivalent  to 

f(a)   -   0   (mod  2°"*"^)  .  (14) 

The  discussion  of  the  previous  paragraph  hence  applies  and  we  conclude  at 
once  that 

f(e)  -  (a^'^  -  i)((--^^)/(^^)  (15) 

generates  a  linear  recursion  relation  of  type  (3)  for  all  Xq 

and  b.   Thus,  aside  from  a  possible  slight  increase  in  the  order  of  the 
recursion  relation,  the  correlation  structure  of  the  b  -  0  case  applies  here 
as  well,  and  care  must  be  taken  -  e.g.  by  skipping  members  of  the  sequence  or 
by  random  changes  in  b  -  to  avoid  computational  artifacts  in  a  wide  variety 
of  applications. 
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